CA2926861C - Fiducial marker patterns, their automatic detection in images, and applications thereof - Google Patents

Fiducial marker patterns, their automatic detection in images, and applications thereof Download PDF

Info

Publication number
CA2926861C
CA2926861C CA2926861A CA2926861A CA2926861C CA 2926861 C CA2926861 C CA 2926861C CA 2926861 A CA2926861 A CA 2926861A CA 2926861 A CA2926861 A CA 2926861A CA 2926861 C CA2926861 C CA 2926861C
Authority
CA
Canada
Prior art keywords
image
marker
markers
display
graphics
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA2926861A
Other languages
English (en)
French (fr)
Other versions
CA2926861A1 (en
Inventor
Mark Fiala
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Millennium Three Technologies Inc
Original Assignee
Millennium Three Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Millennium Three Technologies Inc filed Critical Millennium Three Technologies Inc
Publication of CA2926861A1 publication Critical patent/CA2926861A1/en
Application granted granted Critical
Publication of CA2926861C publication Critical patent/CA2926861C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25—Output arrangements for video game devices
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • A63F13/65—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00—Computer-aided design [CAD]
    • G06F30/20—Design optimisation, verification or simulation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/277—Analysis of motion involving stochastic approaches, e.g. using Kalman filters
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8076—Shooting
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00—Details relating to CAD techniques
    • G06F2111/18—Details relating to CAD techniques using virtual or augmented reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00—Computer-aided design [CAD]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker
    • G06T2207/30208—Marker matrix

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Evolutionary Computation (AREA)
  • Geometry (AREA)
  • General Engineering & Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
CA2926861A 2014-05-21 2015-05-21 Fiducial marker patterns, their automatic detection in images, and applications thereof Active CA2926861C (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201462001071P 2014-05-21 2014-05-21
US62/001,071 2014-05-21
US201462043412P 2014-08-29 2014-08-29
US62/043,412 2014-08-29
PCT/CA2015/000329 WO2015176163A1 (en) 2014-05-21 2015-05-21 Fiducial marker patterns, their automatic detection in images, and applications thereof

Publications (2)

Publication Number Publication Date
CA2926861A1 CA2926861A1 (en) 2015-11-26
CA2926861C true CA2926861C (en) 2017-03-07

Family

ID=54553135

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2926861A Active CA2926861C (en) 2014-05-21 2015-05-21 Fiducial marker patterns, their automatic detection in images, and applications thereof

Country Status (4)

Country Link
US (4) US10504231B2 (en<br>)
EP (1) EP3146729A4 (en<br>)
CA (1) CA2926861C (en<br>)
WO (1) WO2015176163A1 (en<br>)

Families Citing this family (144)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015134794A2 (en) 2014-03-05 2015-09-11 Smart Picture Technologies, Inc. Method and system for 3d capture based on structure from motion with simplified pose detection
US20150369593A1 (en) * 2014-06-19 2015-12-24 Kari MYLLYKOSKI Orthographic image capture system
US20170061700A1 (en) * 2015-02-13 2017-03-02 Julian Michael Urbach Intercommunication between a head mounted display and a real world object
CA2979217C (en) * 2015-03-09 2023-12-12 Alchemy Systems, L.P. Augmented reality
GB2536650A (en) 2015-03-24 2016-09-28 Augmedics Ltd Method and system for combining video-based and optic-based augmented reality in a near eye display
US9886230B2 (en) * 2015-06-07 2018-02-06 Apple Inc. Device, method, and graphical user interface for collaborative editing in documents
US10083522B2 (en) * 2015-06-19 2018-09-25 Smart Picture Technologies, Inc. Image based measurement system
US9836895B1 (en) 2015-06-19 2017-12-05 Waymo Llc Simulating virtual objects
WO2017015046A1 (en) 2015-07-17 2017-01-26 Crown Equipment Corporation Processing device having a graphical user interface for industrial vehicle
US10234305B2 (en) * 2015-08-27 2019-03-19 Here Global B.V. Method and apparatus for providing a targeted map display from a plurality of data sources
CN105160854B (zh) * 2015-09-16 2019-01-11 小米科技有限责任公司 设备控制方法、装置和终端设备
JP6886236B2 (ja) * 2015-09-30 2021-06-16 富士通株式会社 視野誘導方法、視野誘導プログラム、及び視野誘導装置
GB2543320B (en) 2015-10-14 2020-05-13 Sony Interactive Entertainment Inc Head-mountable display system
CA3002911A1 (en) * 2015-10-22 2017-04-27 Grey Orange Pte Ltd Automated fault diagnosis and recovery of machines
US10962780B2 (en) * 2015-10-26 2021-03-30 Microsoft Technology Licensing, Llc Remote rendering for virtual images
DE102015222167A1 (de) * 2015-11-11 2017-05-11 Kuka Roboter Gmbh Verfahren zum vereinfachten ändern von applikationsprogrammen zur steuerung einer industrieanlage
DE102015222164A1 (de) 2015-11-11 2017-05-11 Kuka Roboter Gmbh Verfahren und Computerprogramm zur Erzeugung einer grafischen Benutzerschnittstelle eines Manipulatorprogramms
DE102015222168B4 (de) 2015-11-11 2024-02-22 Kuka Roboter Gmbh Verfahren und computerprogramm zur korrektur von fehlern eines manipulatorsystems
US20180045960A1 (en) 2015-12-02 2018-02-15 Augmenteum, LLC. System for and method of projecting augmentation imagery in a head-mounted display
US9973746B2 (en) 2016-02-17 2018-05-15 Gopro, Inc. System and method for presenting and viewing a spherical video segment
US9602795B1 (en) 2016-02-22 2017-03-21 Gopro, Inc. System and method for presenting and viewing a spherical video segment
WO2017163514A1 (ja) 2016-03-23 2017-09-28 日本電気株式会社 眼鏡型ウェアラブル端末、その制御方法および制御プログラム
US10249084B2 (en) * 2016-06-10 2019-04-02 Microsoft Technology Licensing, Llc Tap event location with a selection apparatus
US10591988B2 (en) * 2016-06-28 2020-03-17 Hiscene Information Technology Co., Ltd Method for displaying user interface of head-mounted display device
WO2018008232A1 (ja) * 2016-07-04 2018-01-11 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
US10296940B2 (en) * 2016-08-26 2019-05-21 Minkonet Corporation Method of collecting advertisement exposure data of game video
US20180092698A1 (en) * 2016-10-04 2018-04-05 WortheeMed, Inc. Enhanced Reality Medical Guidance Systems and Methods of Use
US10306180B2 (en) * 2016-10-21 2019-05-28 Liquidsky Software, Inc. Predictive virtual reality content streaming techniques
US10535169B2 (en) 2016-11-02 2020-01-14 United Parcel Service Of America, Inc. Displaying items of interest in an augmented reality environment
US10922836B2 (en) * 2016-11-15 2021-02-16 Carl Zeiss Industrielle Messtechnik Gmbh Method and system for determining a 3D position of an object in space
WO2018098026A1 (en) 2016-11-22 2018-05-31 Crown Equipment Corporation User interface device for industrial vehicle
CN109313799B (zh) * 2016-12-21 2021-02-26 华为技术有限公司 图像处理方法及设备
US11132840B2 (en) * 2017-01-16 2021-09-28 Samsung Electronics Co., Ltd Method and device for obtaining real time status and controlling of transmitting devices
CN106851567B (zh) * 2017-01-16 2020-05-26 深圳拓邦股份有限公司 一种定位方法、装置及系统
US10768425B2 (en) * 2017-02-14 2020-09-08 Securiport Llc Augmented reality monitoring of border control systems
US11164351B2 (en) * 2017-03-02 2021-11-02 Lp-Research Inc. Augmented reality for sensor applications
US20180268614A1 (en) * 2017-03-16 2018-09-20 General Electric Company Systems and methods for aligning pmi object on a model
US10444506B2 (en) 2017-04-03 2019-10-15 Microsoft Technology Licensing, Llc Mixed reality measurement with peripheral tool
US10489651B2 (en) * 2017-04-14 2019-11-26 Microsoft Technology Licensing, Llc Identifying a position of a marker in an environment
US10871934B2 (en) 2017-05-04 2020-12-22 Microsoft Technology Licensing, Llc Virtual content displayed with shared anchor
EP3416092A1 (en) * 2017-06-16 2018-12-19 Thomson Licensing Method and devices to optimize marker management for pose estimation
CN107101632A (zh) * 2017-06-19 2017-08-29 北京视境技术有限公司 基于多摄像头与多标识物的空间定位装置及方法
GB2566923B (en) * 2017-07-27 2021-07-07 Mo Sys Engineering Ltd Motion tracking
GB2566924B (en) * 2017-07-27 2022-08-03 Mo Sys Engineering Ltd Positioning system
US10304254B2 (en) 2017-08-08 2019-05-28 Smart Picture Technologies, Inc. Method for measuring and modeling spaces using markerless augmented reality
US11797910B2 (en) 2017-08-15 2023-10-24 United Parcel Service Of America, Inc. Hands-free augmented reality system for picking and/or sorting assets
US11156471B2 (en) 2017-08-15 2021-10-26 United Parcel Service Of America, Inc. Hands-free augmented reality system for picking and/or sorting assets
WO2019055023A1 (en) * 2017-09-15 2019-03-21 Honeywell International Inc. REMOTE CONTROLLED AIRCRAFT VEHICLE PROVIDING FIELD SENSOR COMMUNICATION AND SITE IMAGING DURING FACTORY FAILURE CONDITIONS
US10446131B2 (en) * 2017-09-20 2019-10-15 Mitek Corp., Inc. Printable diffuser
CN109559344B (zh) * 2017-09-26 2023-10-13 腾讯科技（上海）有限公司 边框检测方法、装置及存储介质
US11861898B2 (en) * 2017-10-23 2024-01-02 Koninklijke Philips N.V. Self-expanding augmented reality-based service instructions library
US10593101B1 (en) * 2017-11-01 2020-03-17 Facebook Technologies, Llc Marker based tracking
GB2570100B (en) * 2017-11-15 2022-10-26 Mo Sys Engineering Ltd Tool positioning
CN107918955A (zh) * 2017-11-15 2018-04-17 百度在线网络技术（北京）有限公司 增强现实方法和装置
US11222081B2 (en) * 2017-11-27 2022-01-11 Evoqua Water Technologies Llc Off-line electronic documentation solutions
US10816334B2 (en) 2017-12-04 2020-10-27 Microsoft Technology Licensing, Llc Augmented reality measurement and schematic system including tool having relatively movable fiducial markers
US10706318B2 (en) * 2017-12-12 2020-07-07 Intel Corporation Systems, apparatus, and methods to improve object recognition
GB2569544B (en) 2017-12-19 2022-07-20 Displaylink Uk Ltd Transmission of a reverse video feed
US20190197818A1 (en) * 2017-12-27 2019-06-27 Igt Calibrating object sensor devices in a gaming system
CN110120100B (zh) * 2018-02-06 2023-07-14 广东虚拟现实科技有限公司 图像处理方法、装置及识别跟踪系统
BR102018003125B1 (pt) 2018-02-19 2022-05-10 Petróleo Brasileiro S.A. - Petrobras Método para reconhecimento ótico de marcadores em ambiente externo
CA3059064C (en) 2018-03-07 2022-01-04 Magic Leap, Inc. Visual tracking of peripheral devices
US11042226B2 (en) * 2018-04-02 2021-06-22 Microsoft Technology Licensing, Llc Constellation-based augmentation of mouse form-factor for virtual reality applications
US10528998B2 (en) * 2018-04-11 2020-01-07 Trivver, Inc. Systems and methods for presenting information related to products or services being shown on a second display device on a first display device using augmented reality technology
US11847773B1 (en) 2018-04-27 2023-12-19 Splunk Inc. Geofence-based object identification in an extended reality environment
US11145123B1 (en) * 2018-04-27 2021-10-12 Splunk Inc. Generating extended reality overlays in an industrial environment
KR101973653B1 (ko) * 2018-04-30 2019-04-29 주식회사 유니크유엑스 증강 현실 기반 콘텐츠 제공 시스템과 그 방법
WO2019212492A1 (en) 2018-04-30 2019-11-07 Hewlett-Packard Development Company, L.P. Region of interest monitoring and control for additive manufacturing
EP3787543A4 (en) 2018-05-02 2022-01-19 Augmedics Ltd. REGISTRATION OF A REFERENCE MARK FOR AN AUGMENTED REALITY SYSTEM
JP6740288B2 (ja) * 2018-07-13 2020-08-12 ファナック株式会社 物体検査装置、物体検査システム、及び検査位置を調整する方法
US10953541B2 (en) 2018-07-31 2021-03-23 At&T Intellectual Property I, L.P. Providing logistical support for robots
US11004270B2 (en) * 2018-09-11 2021-05-11 Houzz, Inc. Virtual item placement system
US11036284B2 (en) * 2018-09-14 2021-06-15 Apple Inc. Tracking and drift correction
US11010919B2 (en) 2018-09-20 2021-05-18 Ford Global Technologies, Llc Object locator with fiducial marker
CA3114040A1 (en) 2018-09-26 2020-04-02 Guardian Glass, LLC Augmented reality system and method for substrates, coated articles, insulating glass units, and/or the like
WO2020076826A1 (en) * 2018-10-08 2020-04-16 30 60 90 Corporation System and methods for providing time and space altered view in augmented reality and virtual reality environments
US11030796B2 (en) * 2018-10-17 2021-06-08 Adobe Inc. Interfaces and techniques to retarget 2D screencast videos into 3D tutorials in virtual reality
JP6552775B1 (ja) * 2018-10-31 2019-07-31 東芝三菱電機産業システム株式会社 ハイブリッドレンダリングｈｍｉ端末装置
US10997761B2 (en) * 2018-11-09 2021-05-04 Imaginear Inc. Systems and methods for creating and delivering augmented reality content
CA3120145A1 (en) 2018-11-16 2020-05-22 Geomni, Inc. Systems and methods for generating augmented reality environments from two-dimensional drawings
US11287874B2 (en) 2018-11-17 2022-03-29 Novarad Corporation Using optical codes with augmented reality displays
US11766296B2 (en) 2018-11-26 2023-09-26 Augmedics Ltd. Tracking system for image-guided surgery
US10939977B2 (en) 2018-11-26 2021-03-09 Augmedics Ltd. Positioning marker
KR20200064577A (ko) * 2018-11-29 2020-06-08 전자부품연구원 증강현실을 위한 모바일 홀로그램 디스플레이 단말기
US20200186786A1 (en) * 2018-12-06 2020-06-11 Novarad Corporation Calibration for Augmented Reality
US11204594B2 (en) * 2018-12-13 2021-12-21 Fisher-Rosemount Systems, Inc. Systems, methods, and apparatus to augment process control with virtual assistant
JP7137743B2 (ja) * 2018-12-26 2022-09-15 株式会社Ｊｖｃケンウッド 映像表示システム、映像表示装置、及び映像表示方法
CN113226952B (zh) * 2018-12-27 2023-04-18 日本电气通信系统株式会社 物品位置管理装置、物品位置管理系统、物品位置管理方法和程序
TWI687745B (zh) * 2018-12-27 2020-03-11 國立交通大學 近眼擴增實境裝置
US11113819B2 (en) * 2019-01-15 2021-09-07 Nvidia Corporation Graphical fiducial marker identification suitable for augmented reality, virtual reality, and robotics
CN111460871B (zh) * 2019-01-18 2023-12-22 北京市商汤科技开发有限公司 图像处理方法及装置、存储介质
US11835960B2 (en) * 2019-01-28 2023-12-05 Zebra Technologies Corporation System and method for semantically identifying one or more of an object and a location in a robotic environment
TWI725574B (zh) * 2019-02-22 2021-04-21 宏達國際電子股份有限公司 頭戴式顯示裝置以及眼球追蹤游標的顯示方法
CN109949366A (zh) * 2019-03-08 2019-06-28 鲁班嫡系机器人（深圳）有限公司 一种定位设备及其方法
US11785184B2 (en) * 2019-03-22 2023-10-10 Spp Technologies Co., Ltd. Maintenance support system, maintenance support method, and program
EP3946825A1 (en) * 2019-03-25 2022-02-09 ABB Schweiz AG Method and control arrangement for determining a relation between a robot coordinate system and a movable apparatus coordinate system
CN111752425B (zh) * 2019-03-27 2022-02-15 北京外号信息技术有限公司 用于选择在设备的显示媒介上的交互对象的方法
US10890918B2 (en) 2019-04-24 2021-01-12 Innovation First, Inc. Performance arena for robots with position location system
US11194438B2 (en) * 2019-05-09 2021-12-07 Microsoft Technology Licensing, Llc Capture indicator for a virtual world
US11138757B2 (en) 2019-05-10 2021-10-05 Smart Picture Technologies, Inc. Methods and systems for measuring and modeling spaces using markerless photo-based augmented reality process
CN112241200A (zh) * 2019-07-17 2021-01-19 苹果公司 头戴式设备的对象跟踪
US11980506B2 (en) 2019-07-29 2024-05-14 Augmedics Ltd. Fiducial marker
US11445107B2 (en) * 2019-08-08 2022-09-13 Qorvo Us, Inc. Supervised setup for control device with imager
JP7404011B2 (ja) * 2019-09-24 2023-12-25 東芝テック株式会社 情報処理装置
WO2021061134A1 (en) * 2019-09-26 2021-04-01 Hewlett-Packard Development Company, L.P. Geospatial display configuration
US11100672B2 (en) * 2019-09-27 2021-08-24 Myntra Designs Private Limited System and method for reducing jitter in augmented reality
JP7359633B2 (ja) * 2019-10-17 2023-10-11 ファナック株式会社 ロボットシステム
US20220374941A1 (en) * 2019-10-25 2022-11-24 Nec Solution Innovators, Ltd. Information sharing apparatus, event support system, information sharing method, and event support system production method
JPWO2021079821A1 (en<br>) * 2019-10-25 2021-04-29
US20220366451A1 (en) * 2019-10-25 2022-11-17 Nec Solution Innovators, Ltd. Display apparatus, event support system, display method, and event support system production method
EP4058981A4 (en) * 2019-11-11 2024-01-03 Aveva Software Llc VISUAL ARTIFICIAL INTELLIGENCE IN SCADA SYSTEMS
US11382712B2 (en) 2019-12-22 2022-07-12 Augmedics Ltd. Mirroring in image guided surgery
TWI798514B (zh) * 2019-12-25 2023-04-11 亞達科技股份有限公司 人工智慧輔助擴增實境系統與方法、電腦程式產品
CN111210461B (zh) * 2019-12-30 2023-06-02 成都慧视光电技术有限公司 一种自适应尺度变化的实时相关滤波跟踪算法
US11237627B2 (en) 2020-01-16 2022-02-01 Novarad Corporation Alignment of medical images in augmented reality displays
CN115668281A (zh) * 2020-01-24 2023-01-31 博迪维仁医疗有限公司 使用多视图姿态估计的方法和系统
US11829194B2 (en) 2020-05-08 2023-11-28 Esko Software Bv Method and system for deriving a digital representation of an unfolded blank and for cost estimation based upon the same
WO2021236107A1 (en) * 2020-05-22 2021-11-25 Purdue Research Foundation Fiducial patterns
US11295135B2 (en) * 2020-05-29 2022-04-05 Corning Research & Development Corporation Asset tracking of communication equipment via mixed reality based labeling
US11374808B2 (en) 2020-05-29 2022-06-28 Corning Research & Development Corporation Automated logging of patching operations via mixed reality based labeling
US11302077B2 (en) 2020-05-29 2022-04-12 Snap Inc. Augmented reality guidance that generates guidance markers
US11389252B2 (en) 2020-06-15 2022-07-19 Augmedics Ltd. Rotating marker for image guided surgery
US20210398314A1 (en) * 2020-06-17 2021-12-23 Qualcomm Incorporated Low power visual tracking systems
US20220051013A1 (en) * 2020-08-11 2022-02-17 Disney Enterprises, Inc. Item location tracking via image analysis and projection
CN112070801B (zh) * 2020-08-31 2023-08-11 上海沈德医疗器械科技有限公司 一种基于图像的运动检测方法
US20230316806A1 (en) * 2020-09-18 2023-10-05 Hewlett-Packard Development Company, L.P. Fiducial mark document sharing
US20220115981A1 (en) * 2020-10-08 2022-04-14 The Regents Of The University Of Colorado, A Body Corporate Systems and methods for conserving thermal and electrical energy usage in buildings and houses
US11544343B1 (en) * 2020-10-16 2023-01-03 Splunk Inc. Codeless anchor generation for detectable features in an environment
US11522945B2 (en) * 2020-10-20 2022-12-06 Iris Tech Inc. System for providing synchronized sharing of augmented reality content in real time across multiple devices
CN112631421B (zh) * 2020-12-07 2022-07-26 联想(北京)有限公司 消息传输控制方法、装置及电子设备
JP7405735B2 (ja) * 2020-12-21 2023-12-26 トヨタ自動車株式会社 表示システム、表示装置、及びプログラム
CN112819967A (zh) * 2021-01-14 2021-05-18 京东方科技集团股份有限公司 一种显示方法、装置及系统、存储介质、显示器
US11688080B2 (en) * 2021-04-30 2023-06-27 Microsoft Technology Licensing, Llc Tracking in a moving platform
US11896445B2 (en) 2021-07-07 2024-02-13 Augmedics Ltd. Iliac pin and adapter
US11551402B1 (en) * 2021-07-20 2023-01-10 Fmr Llc Systems and methods for data visualization in virtual reality environments
WO2023086102A1 (en) * 2021-11-12 2023-05-19 Innopeak Technology, Inc. Data visualization in extended reality
WO2023092375A1 (en) * 2021-11-25 2023-06-01 Citrix Systems, Inc. Computing device with live background and related method
CN114529686B (zh) * 2022-04-21 2022-08-02 三一筑工科技股份有限公司 建筑模型的生成方法、装置、设备及介质
US11935201B2 (en) * 2022-04-28 2024-03-19 Dell Products Lp Method and apparatus for using physical devices in extended reality environments
US20230401847A1 (en) * 2022-05-31 2023-12-14 CareAR Holdings LLC System and Method to Create Configurable, Context Sensitive Functions in AR Experiences
EP4307231A1 (en) * 2022-07-15 2024-01-17 Captron Electronic GmbH System and method for localizing articles in an intralogistics environment
EP4332902A1 (de) 2022-09-02 2024-03-06 Sick Ag Lokalisierung eines optischen markers
CN115908730A (zh) * 2022-11-11 2023-04-04 南京理工大学 一种在低通信带宽下远程操控端基于边缘的三维场景重建系统方法
US11945609B1 (en) * 2023-08-16 2024-04-02 Falcon Exodynamics, Inc. System and method for identifying and distinguishing spacecraft appendages from the spacecraft body

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0856829B1 (en) * 1997-01-31 2008-09-24 Hitachi, Ltd. Image displaying system and information processing apparatus with control of display attributes specific for a defined display region
US6330356B1 (en) * 1999-09-29 2001-12-11 Rockwell Science Center Llc Dynamic visual registration of a 3-D object with a graphical model
US20020072809A1 (en) * 2000-10-24 2002-06-13 Michael Zuraw Microcomputer control of physical devices
US20040104935A1 (en) * 2001-01-26 2004-06-03 Todd Williamson Virtual reality immersion system
SG109956A1 (en) * 2001-06-19 2005-04-28 Eutech Cybernetics Pte Ltd Method and apparatus for automatically generating a scada system
US6799080B1 (en) * 2003-06-12 2004-09-28 The Boc Group, Inc. Configurable PLC and SCADA-based control system
EP1735693A4 (en) * 2004-03-30 2009-02-25 Igenus Inc METHOD AND SYSTEM FOR ORGANIZING DATA RELATING TO A PLACE OF RESIDENCE
US20050289590A1 (en) * 2004-05-28 2005-12-29 Cheok Adrian D Marketing platform
US20050285878A1 (en) * 2004-05-28 2005-12-29 Siddharth Singh Mobile platform
US8675995B2 (en) * 2004-07-09 2014-03-18 Terrago Technologies, Inc. Precisely locating features on geospatial imagery
US9867669B2 (en) * 2008-12-31 2018-01-16 Intuitive Surgical Operations, Inc. Configuration marker design and detection for instrument tracking
US8224024B2 (en) * 2005-10-04 2012-07-17 InterSense, LLC Tracking objects with markers
CA2566260C (en) 2005-10-31 2013-10-01 National Research Council Of Canada Marker and method for detecting said marker
US7966239B2 (en) * 2006-02-14 2011-06-21 Leviathan Entertainment, Llc Software-based commerce engine deployed in video game environment
KR100974900B1 (ko) * 2008-11-04 2010-08-09 한국전자통신연구원 동적 임계값을 이용한 마커 인식 장치 및 방법
US8328365B2 (en) * 2009-04-30 2012-12-11 Hewlett-Packard Development Company, L.P. Mesh for mapping domains based on regularized fiducial marks
US8645220B2 (en) 2009-08-28 2014-02-04 Homer Tlc, Inc. Method and system for creating an augmented reality experience in connection with a stored value token
US8751049B2 (en) * 2010-05-24 2014-06-10 Massachusetts Institute Of Technology Kinetic input/output
WO2011149558A2 (en) * 2010-05-28 2011-12-01 Abelow Daniel H Reality alternate
KR101179969B1 (ko) * 2010-12-28 2012-09-05 한양대학교 에리카산학협력단 마커 검출 장치 및 방법
US10019962B2 (en) * 2011-08-17 2018-07-10 Microsoft Technology Licensing, Llc Context adaptive user interface for augmented reality display
US10318941B2 (en) * 2011-12-13 2019-06-11 Visa International Service Association Payment platform interface widget generation apparatuses, methods and systems
US9870429B2 (en) 2011-11-30 2018-01-16 Nokia Technologies Oy Method and apparatus for web-based augmented reality application viewer
US9953378B2 (en) * 2012-04-27 2018-04-24 Visa International Service Association Social checkout widget generation and integration apparatuses, methods and systems
US9298859B2 (en) * 2012-02-13 2016-03-29 Baker Hughes Incorporated Electrical submersible pump design parameters recalibration methods, apparatus, and computer readable medium
AU2013206449A1 (en) * 2012-06-20 2014-01-16 Visa International Service Association Multi-channel remote payment apparatuses, methods and systems
US11857266B2 (en) * 2012-06-21 2024-01-02 Globus Medical, Inc. System for a surveillance marker in robotic-assisted surgery
US10136954B2 (en) * 2012-06-21 2018-11-27 Globus Medical, Inc. Surgical tool systems and method
US9684941B2 (en) * 2012-10-29 2017-06-20 Digimarc Corporation Determining pose for use with digital watermarking, fingerprinting and augmented reality
US9894269B2 (en) * 2012-10-31 2018-02-13 Atheer, Inc. Method and apparatus for background subtraction using focus differences
US9317972B2 (en) 2012-12-18 2016-04-19 Qualcomm Incorporated User interface for augmented reality enabled devices
US10262462B2 (en) * 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
US10062411B2 (en) * 2014-12-11 2018-08-28 Jeffrey R. Hay Apparatus and method for visualizing periodic motions in mechanical components

Also Published As

Publication number Publication date
US11100649B2 (en) 2021-08-24
US11887312B2 (en) 2024-01-30
US10504231B2 (en) 2019-12-10
US20200211198A1 (en) 2020-07-02
CA2926861A1 (en) 2015-11-26
EP3146729A1 (en) 2017-03-29
US10929980B2 (en) 2021-02-23
US20210383551A1 (en) 2021-12-09
US20170249745A1 (en) 2017-08-31
WO2015176163A1 (en) 2015-11-26
US20200090338A1 (en) 2020-03-19
EP3146729A4 (en) 2018-04-11

Similar Documents

Publication Publication Date Title
US11887312B2 (en) Fiducial marker patterns, their automatic detection in images, and applications thereof
KR101930657B1 (ko) 몰입식 및 대화식 멀티미디어 생성을 위한 시스템 및 방법
US10482659B2 (en) System and method for superimposing spatially correlated data over live real-world images
US10402663B1 (en) Visual-inertial positional awareness for autonomous and non-autonomous mapping
US9591295B2 (en) Approaches for simulating three-dimensional views
CN110533723B (zh) 增强现实显示的方法、姿态信息的确定方法及装置
EP2974509B1 (en) Personal information communicator
US10768711B2 (en) Mediated reality
JP2019083001A (ja) 機械学習用の訓練データの効率的な収集のための拡張現実を使用したシステム及び方法
KR20230028532A (ko) 가상 현실 경험들을 위한 지상 실측값 데이터세트들의 생성
US11263818B2 (en) Augmented reality system using visual object recognition and stored geometry to create and render virtual objects
Selvam et al. Augmented reality for information retrieval aimed at museum exhibitions using smartphones
US11341716B1 (en) Augmented-reality system and method
CN112912936A (zh) 混合现实系统、程序、移动终端装置和方法
CN110211243A (zh) Ar设备及其实体标注方法
RE Low cost augmented reality for industrial problems
CN112417904B (zh) 用于呈现与光通信装置有关的信息的方法和电子设备
TWI759764B (zh) 基於光通信裝置疊加虛擬物件的方法、電子設備以及電腦可讀取記錄媒體
EP4102468A1 (en) Augmented-reality system and method
WO2020244576A1 (zh) 基于光通信装置叠加虚拟对象的方法和相应的电子设备
KR102027576B1 (ko) 사용자 맞춤형 vr 체험 시스템
CN112053444A (zh) 基于光通信装置叠加虚拟对象的方法和相应的电子设备
Tsai Geometry-aware augmented reality for remote collaboration

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20160408